get under somebody’s skin
(informal) to annoy somebody
Don't let him get under your skin.